ct imaging
Multimodal Deep Learning for Prediction of Progression-Free Survival in Patients with Neuroendocrine Tumors Undergoing 177Lu-based Peptide Receptor Radionuclide Therapy
Baur, Simon, Ruhwedel, Tristan, Böke, Ekin, Kobus, Zuzanna, Lishkova, Gergana, Wetz, Christoph, Amthauer, Holger, Roderburg, Christoph, Tacke, Frank, Rogasch, Julian M., Samek, Wojciech, Jann, Henning, Ma, Jackie, Eschrich, Johannes
Peptide receptor radionuclide therapy (PRRT) is an established treatment for metastatic neuroendocrine tumors (NETs), yet long-term disease control occurs only in a subset of patients. Predicting progression-free survival (PFS) could support individualized treatment planning. This study evaluates laboratory, imaging, and multimodal deep learning models for PFS prediction in PRRT-treated patients. In this retrospective, single-center study 116 patients with metastatic NETs undergoing 177Lu-DOTATOC were included. Clinical characteristics, laboratory values, and pretherapeutic somatostatin receptor positron emission tomography/computed tomographies (SR-PET/CT) were collected. Seven models were trained to classify low- vs. high-PFS groups, including unimodal (laboratory, SR-PET, or CT) and multimodal fusion approaches. Explainability was evaluated by feature importance analysis and gradient maps. Forty-two patients (36%) had short PFS (< 1 year), 74 patients long PFS (>1 year). Groups were similar in most characteristics, except for higher baseline chromogranin A (p = 0.003), elevated gamma-GT (p = 0.002), and fewer PRRT cycles (p < 0.001) in short-PFS patients. The Random Forest model trained only on laboratory biomarkers reached an AUROC of 0.59 +- 0.02. Unimodal three-dimensional convolutional neural networks using SR-PET or CT performed worse (AUROC 0.42 +- 0.03 and 0.54 +- 0.01, respectively). A multimodal fusion model laboratory values, SR-PET, and CT -augmented with a pretrained CT branch - achieved the best results (AUROC 0.72 +- 0.01, AUPRC 0.80 +- 0.01). Multimodal deep learning combining SR-PET, CT, and laboratory biomarkers outperformed unimodal approaches for PFS prediction after PRRT. Upon external validation, such models may support risk-adapted follow-up strategies.
Outcome prediction and individualized treatment effect estimation in patients with large vessel occlusion stroke
Herzog, Lisa, Bühler, Pascal, de la Rosa, Ezequiel, Sick, Beate, Wegener, Susanne
Mechanical thrombectomy has become the standard of care in patients with stroke due to large vessel occlusion (LVO). However, only 50% of successfully treated patients show a favorable outcome. We developed and evaluated interpretable deep learning models to predict functional outcomes in terms of the modified Rankin Scale score alongside individualized treatment effects (ITEs) using data of 449 LVO stroke patients from a randomized clinical trial. Besides clinical variables, we considered non-contrast CT (NCCT) and angiography (CTA) scans which were integrated using novel foundation models to make use of advanced imaging information. Clinical variables had a good predictive power for binary functional outcome prediction (AUC of 0.719 [0.666, 0.774]) which could slightly be improved when adding CTA imaging (AUC of 0.737 [0.687, 0.795]). Adding NCCT scans or a combination of NCCT and CTA scans to clinical features yielded no improvement. The most important clinical predictor for functional outcome was pre-stroke disability. While estimated ITEs were well calibrated to the average treatment effect, discriminatory ability was limited indicated by a C-for-Benefit statistic of around 0.55 in all models. In summary, the models allowed us to jointly integrate CT imaging and clinical features while achieving state-of-the-art prediction performance and ITE estimates. Yet, further research is needed to particularly improve ITE estimation.
Opportunistic Screening for Pancreatic Cancer using Computed Tomography Imaging and Radiology Reports
Le, David, Correa-Medero, Ramon, Tariq, Amara, Patel, Bhavik, Yano, Motoyo, Banerjee, Imon
Pancreatic ductal adenocarcinoma (PDAC) is a highly aggressive cancer, with most cases diagnosed at stage IV and a five-year overall survival rate below 5%. Early detection and prognosis modeling are crucial for improving patient outcomes and guiding early intervention strategies. In this study, we developed and evaluated a deep learning fusion model that integrates radiology reports and CT imaging to predict PDAC risk. The model achieved a concordance index (C-index) of 0.6750 (95% CI: 0.6429, 0.7121) and 0.6435 (95% CI: 0.6055, 0.6789) on the internal and external dataset, respectively, for 5-year survival risk estimation. Kaplan-Meier analysis demonstrated significant separation (p<0.0001) between the low and high risk groups predicted by the fusion model. These findings highlight the potential of deep learning-based survival models in leveraging clinical and imaging data for pancreatic cancer.
Differentiable Uncalibrated Imaging
Gupta, Sidharth, Kothari, Konik, Debarnot, Valentin, Dokmanić, Ivan
We propose a differentiable imaging framework to address uncertainty in measurement coordinates such as sensor locations and projection angles. We formulate the problem as measurement interpolation at unknown nodes supervised through the forward operator. To solve it we apply implicit neural networks, also known as neural fields, which are naturally differentiable with respect to the input coordinates. We also develop differentiable spline interpolators which perform as well as neural networks, require less time to optimize and have well-understood properties. Differentiability is key as it allows us to jointly fit a measurement representation, optimize over the uncertain measurement coordinates, and perform image reconstruction which in turn ensures consistent calibration. We apply our approach to 2D and 3D computed tomography, and show that it produces improved reconstructions compared to baselines that do not account for the lack of calibration. The flexibility of the proposed framework makes it easy to extend to almost arbitrary imaging problems.
Study finds artificial intelligence may improve diabetes diagnosis
Bethesda (Maryland) [US], April 16 (ANI): A new study has found that a fully-automated artificial intelligence (AI) deep learning model can identify early signs of type 2 diabetes on abdominal CT scans. The findings of the study were published in the journal, 'Radiology'. Type 2 diabetes affects approximately 13 per cent of all U.S. adults and an additional 34.5 per cent of adults meet the criteria for pre-diabetes. Due to the slow onset of symptoms, it is important to diagnose the disease in its early stages. Some cases of pre-diabetes can last up to 8 years and an earlier diagnosis will allow patients to make lifestyle changes to alter the progression of the disease.
Artificial intelligence may improve diabetes diagnosis: Study
Bethesda (Maryland) [US], April 12 (ANI): According to a new study, researchers using a fully-automated artificial intelligence (AI) deep learning model were able to identify early signs of diabetes" type 2 diabetes on abdominal CT scans. The study was published in the journal, 'Radiology'. Type 2 diabetes affects approximately 13 per cent of all U.S. adults and an additional 34.5 per cent of adults meet the criteria for prediabetes. Due to the slow onset of symptoms, it is important to diagnose the disease in its early stages. Some cases of pre-diabetes can last up to 8 years and an earlier diagnosis will allow patients to make lifestyle changes to alter the progression of the disease. Abdominal CT imaging can be a promising tool to diagnose diabetes" type 2 diabetes.
Artificial intelligence may improve diabetes diagnosis: Study
Bethesda: According to a new study, researchers using a fully-automated artificial intelligence (AI) deep learning model were able to identify early signs of type 2 diabetes on abdominal CT scans. The study was published in the journal, 'Radiology'. Type 2 diabetes affects approximately 13 per cent of all U.S. adults and an additional 34.5 per cent of adults meet the criteria for prediabetes. Due to the slow onset of symptoms, it is important to diagnose the disease in its early stages. Some cases of pre-diabetes can last up to 8 years and an earlier diagnosis will allow patients to make lifestyle changes to alter the progression of the disease.
Artificial Intelligence May Improve Diabetes Diagnosis
Abdominal CT imaging can be a promising tool to diagnose type 2 diabetes. CT imaging is already widely used in clinical practices, and it can provide a significant amount of information about the pancreas. Previous studies have shown that patients with diabetes tend to accumulate more visceral fat and fat within the pancreas than non-diabetic patients. However, not much work has been done to study the liver, muscles, and blood vessels around the pancreas, said study co-senior author Ronald M. Summers, MD, PhD, senior investigator and staff radiologist at the National Institutes of Health Clinical Center in Bethesda, Maryland.
The Impact of Artificial Intelligence on CT Imaging
In the STOIC study, readers classified CT exams as COVID positive, COVID negative or normal. The readers had access to the CT scans using a 3-D image visualization web application, allowing scrolling through the entire lung volume in the coronal, sagittal or axial transverse plane. The CT scan shown here has been classified as COVID positive due to the presence of bilateral ground glass opacities and absence of features such as mucoid impaction, bronchiolar nodules, segmental or lobar consolidation.
Low Dose Helical CBCT denoising by using domain filtering with deep reinforcement learning
Cone Beam Computed Tomography(CBCT) is a now known method to conduct CT imaging. Especially, The Low Dose CT imaging is one of possible options to protect organs of patients when conducting CT imaging. Therefore Low Dose CT imaging can be an alternative instead of Standard dose CT imaging. However Low Dose CT imaging has a fundamental issue with noises within results compared to Standard Dose CT imaging. Currently, there are lots of attempts to erase the noises. Most of methods with artificial intelligence have many parameters and unexplained layers or a kind of black-box methods. Therefore, our research has purposes related to these issues. Our approach has less parameters than usual methods by having Iterative learn-able bilateral filtering approach with Deep reinforcement learning. And we applied The Iterative learn-able filtering approach with deep reinforcement learning to sinograms and reconstructed volume domains. The method and the results of the method can be much more explainable than The other black box AI approaches. And we applied the method to Helical Cone Beam Computed Tomography(CBCT), which is the recent CBCT trend. We tested this method with on 2 abdominal scans(L004, L014) from Mayo Clinic TCIA dataset. The results and the performances of our approach overtake the results of the other previous methods.